Leadership dynamics in musical groups: Quantifying effects of musical structure on directionality of influence in concert performance videos.

Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings. It was hypothesised that the directionality of influence, indexed by Granger Causality, would be greater for 'homophonic' textures with a clear distinction between melody and accompaniment parts than for 'polyphonic' textures with less distinction between melody and accompaniment. This hypothesis was tested by using pose estimation algorithms to track instrumentalists' body movements in a string quartet and a clarinet quintet, and then applying Granger Causality analysis to their head motion to estimate directional influence between instrumentalist pairs for sections of the pieces that varied in texture. It was found that Granger Causality values were generally higher (indicating greater directionality of influence) for homophonic than polyphonic textures. Furthermore, considering melody and accompaniment instrument roles revealed more evidence for the melody instrument influencing accompanying instruments than vice versa, plus a high degree of directionality among accompanying instruments, in homophonic textures. These observed patterns of directional information flow in co-performer body motion are consistent with changing leader-follower relations depending on hierarchical relations between ensemble parts in terms of the relative salience of melodic material in the musical texture. The finding that automatic pose estimation can detect modulations of leadership dynamics in standard video recordings under naturalistic performance conditions has implications for investigating interpersonal coordination in large-scale music video datasets representing different cultural traditions, and for exploring nonverbal communication in group activities more generally.

Resilience improvement through a multicomponent physical and cognitive intervention for older people: the DanzArTe emotional well-being technology project.

BACKGROUND: Resilience is a crucial component of successful aging. However, which interventions might increase resilience in older adults is yet unclear. AIMS: This study aims to assess the feasibility and the physical and psychological effects of a technology-based multicomponent dance movement intervention that includes physical, cognitive, and sensory activation in older people living in community-dwelling and nursing home. METHODS: DanzArTe program consists of four sessions on a weekly basis, using a technological platform that integrates visual and auditory contents in real time. 122 participants (mean age = 76.3 ± 8.8 years, 91 females = 74.6%) from seven nursing homes and community-dwelling subjects were assessed, before and after the intervention, with the Resilience Scale-14 items (RES-14), the Multidimensional Prognostic Index (MPI), the Psychological General Well-Being Index (PGWBI-S), and the Client Satisfaction Questionnaire-8 (CSQ-8). Mann-Whitney and Wilcoxon signed-ranks tests were used for statistical analyses. RESULTS: At baseline significant differences in MPI and RES-14 between community-dwelling and nursing home residents were observed (p < 0.001 for both analyses). After the intervention, resilience significantly increased in total sample (RES-14 mean T1 = 74.6 Vs. T2 = 75.7) and in the nursing home residents (RES-14 mean T1 = 68.1 Vs. T2 = 71.8). All participants showed high overall satisfaction for DanzArTe program (CSQ-8 mean = 23.9 ± 4.4). No differences in MPI and PGWBI-S were observed. DISCUSSION: DanzArTe was a feasible intervention and high appreciated by all older adults. Nursing home residents revealed improvements in resilience after DanzArTe program. CONCLUSION: The DanzArTe technology-based multi-component intervention may improve resilience in older people living in nursing homes.

The PRO-HOME Project. A multicomponent intervention for the protected discharge from the hospital of multimorbid and polytreated older individuals by using innovative technologies: A pilot study.

BACKGROUD: Discharge planning from the hospital of frail older patients is an important step to avoid inappropriate long-stay hospitalizations and to prevent the risks related to the prolonged hospitalization. In this frame, we developed an experimental trial-'PRO-HOME', a multicomponent programme of interventions for multimorbid and polytreated hospitalized older patients. AIM: The main aim of the study was to develop a protected discharge facility using a mini apartment equipped with advanced architectural and technological components to reduce the length of hospital stay of older participants (aged 65+ years old) admitted to the hospital for an acute event, deemed stable and dischargeable. MATERIALS AND METHODS: This is a pilot randomized controlled study, comparing 30 hospitalized participants included in a multidimensional, transitional care programme based on information and communication technologies to 30 patients in standard usual care until hospital discharge. RESULTS: We presented the study design of the PRO-HOME programme, including architectural and technological components, the enrolment procedures, the components of the intervention that is physical activity, cognitive training and life-style education and the evaluation method of the intervention based on the Comprehensive Geriatric Assessment to explore the changes in the individual domains that are target of the multicomponent intervention. CONCLUSIONS: The final results will suggest whether the PRO-HOME programme represents a useful and feasible intervention to reduce the length of hospital stay of multimorbid and polytreated hospitalized older patients and improve their physical and cognitive performances and overall quality of life. PATIENT OR PUBLIC CONTRIBUTION: Due to the characteristics of the population of interest of the PRO-HOME study, we involved in the study design and programme of the activities the participants enrolled in a previous smart home-based project named MoDiPro carried-out during a 3-year period. The elderly participants from the local population involved were asked, by means of focus groups, for feedback on their experience in MoDiPro, and their suggestions were integrated into the design phase of the current PRO-HOME project. The focus groups included open group interviews with a qualitative collection of the patients' feedback so that the participants could interact with each other.

Interpersonal sensorimotor communication shapes intrapersonal coordination in a musical ensemble.

Social behaviors rely on the coordination of multiple effectors within one's own body as well as between the interacting bodies. However, little is known about how coupling at the interpersonal level impacts coordination among body parts at the intrapersonal level, especially in ecological, complex, situations. Here, we perturbed interpersonal sensorimotor communication in violin players of an orchestra and investigated how this impacted musicians' intrapersonal movements coordination. More precisely, first section violinists were asked to turn their back to the conductor and to face the second section of violinists, who still faced the conductor. Motion capture of head and bow kinematics showed that altering the usual interpersonal coupling scheme increased intrapersonal coordination. Our perturbation also induced smaller yet more complex head movements, which spanned multiple, faster timescales that closely matched the metrical levels of the musical score. Importantly, perturbation differentially increased intrapersonal coordination across these timescales. We interpret this behavioral shift as a sensorimotor strategy that exploits periodical movements to effectively tune sensory processing in time and allows coping with the disruption in the interpersonal coupling scheme. As such, head movements, which are usually deemed to fulfill communicative functions, may possibly be adapted to help regulate own performance in time.

A functional magnetic resonance imaging examination of audiovisual observation of a point-light string quartet using intersubject correlation and physical feature analysis.

We use functional Magnetic Resonance Imaging (fMRI) to explore synchronized neural responses between observers of audiovisual presentation of a string quartet performance during free viewing. Audio presentation was accompanied by visual presentation of the string quartet as stick figures observed from a static viewpoint. Brain data from 18 musical novices were obtained during audiovisual presentation of a 116 s performance of the allegro of String Quartet, No. 14 in D minor by Schubert played by the 'Quartetto di Cremona.' These data were analyzed using intersubject correlation (ISC). Results showed extensive ISC in auditory and visual areas as well as parietal cortex, frontal cortex and subcortical areas including the medial geniculate and basal ganglia (putamen). These results from a single fixed viewpoint of multiple musicians are greater than previous reports of ISC from unstructured group activity but are broadly consistent with related research that used ISC to explore listening to music or watching solo dance. A feature analysis examining the relationship between brain activity and physical features of the auditory and visual signals yielded findings of a large proportion of activity related to auditory and visual processing, particularly in the superior temporal gyrus (STG) as well as midbrain areas. Motor areas were also involved, potentially as a result of watching motion from the stick figure display of musicians in the string quartet. These results reveal involvement of areas such as the putamen in processing complex musical performance and highlight the potential of using brief naturalistic stimuli to localize distinct brain areas and elucidate potential mechanisms underlying multisensory integration.

Bridging the gap between emotion and joint action.

Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through embodied presence in a group, and how joint action changes individual emotion. In fact, the multi-agent component is largely missing from neuroscience-based approaches to emotion, and reversely joint action research has not found a way yet to include emotion as one of the key parameters to model socio-motor interaction. In this review, we first identify the gap and then stockpile evidence showing strong entanglement between emotion and acting together from various branches of sciences. We propose an integrative approach to bridge the gap, highlight five research avenues to do so in behavioral neuroscience and digital sciences, and address some of the key challenges in the area faced by modern societies.

Author Correction: Multi-layer adaptation of group coordination in musical ensembles.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Multi-layer adaptation of group coordination in musical ensembles.

Group coordination passes through an efficient integration of multimodal sources of information. This study examines complex non-verbal communication by recording movement kinematics from conductors and two sections of violinists of an orchestra adapting to a perturbation affecting their normal pattern of sensorimotor communication (rotation of half a turn of the first violinists' section). We show that different coordination signals are channeled through ancillary (head kinematics) and instrumental movements (bow kinematics). Each one of them affect coordination either at the inter-group or intra-group levels, therefore tapping into different modes of cooperation: complementary versus imitative coordination. Our study suggests that the co-regulation of group behavior is based on the exchange of information across several layers, each one of them tuned to carry specific coordinative signals. Multi-layer sensorimotor communication may be the key musicians and, more generally humans, use to flexibly communicate between each other in interactive sensorimotor tasks.

Computational Feature Analysis of Body Movements Reveals Hierarchical Brain Organization.

Social species spend considerable time observing the body movements of others to understand their actions, predict their emotions, watch their games, or enjoy their dance movements. Given the important information obtained from body movements, we still know surprisingly little about the details of brain mechanisms underlying movement perception. In this fMRI study, we investigated the relations between movement features obtained from automated computational analyses of video clips and the corresponding brain activity. Our results show that low-level computational features map to specific brain areas related to early visual- and motion-sensitive regions, while mid-level computational features are related to dynamic aspects of posture encoded in occipital-temporal cortex, posterior superior temporal sulcus and superior parietal lobe. Furthermore, behavioral features obtained from subjective ratings correlated with activity in higher action observation regions. Our computational feature-based analysis suggests that the neural mechanism of movement encoding is organized in the brain not so much by semantic categories than by feature statistics of the body movements.

Measuring social interaction in music ensembles.

Music ensembles are an ideal test-bed for quantitative analysis of social interaction. Music is an inherently social activity, and music ensembles offer a broad variety of scenarios which are particularly suitable for investigation. Small ensembles, such as string quartets, are deemed a significant example of self-managed teams, where all musicians contribute equally to a task. In bigger ensembles, such as orchestras, the relationship between a leader (the conductor) and a group of followers (the musicians) clearly emerges. This paper presents an overview of recent research on social interaction in music ensembles with a particular focus on (i) studies from cognitive neuroscience; and (ii) studies adopting a computational approach for carrying out automatic quantitative analysis of ensemble music performances.

An investigation of the 'female camouflage effect' in autism using a computerized ADOS-2 and a test of sex/gender differences.

BACKGROUND: Autism spectrum conditions (autism) are diagnosed more frequently in boys than in girls. Females with autism may have been under-identified due to not only a male-biased understanding of autism but also females' camouflaging. The study describes a new technique that allows automated coding of non-verbal mode of communication (gestures) and offers the possibility of objective, evaluation of gestures, independent of human judgment. The EyesWeb software platform and the Kinect sensor during two demonstration activities of ADOS-2 (Autism Diagnostic Observation Schedule, Second Edition) were used. METHODS: The study group consisted of 33 high-functioning Polish girls and boys with formal diagnosis of autism or Asperger syndrome aged 5-10, with fluent speech, IQ average and above and their parents (girls with autism, n = 16; boys with autism, n = 17). All children were assessed during two demonstration activities of Module 3 of ADOS-2, administered in Polish, and coded using Polish codes. Children were also assessed with Polish versions of the Eyes and Faces Tests. Parents provided information on the author-reviewed Polish research translation of SCQ (Social Communication Questionnaire, Current and Lifetime) and Polish version of AQ Child (Autism Spectrum Quotient, Child). RESULTS: Girls with autism tended to use gestures more vividly as compared to boys with autism during two demonstration activities of ADOS-2. Girls with autism made significantly more mistakes than boys with autism on the Faces Test. All children with autism had high scores in AQ Child, which confirmed the presence of autistic traits in this group. The current communication skills of boys with autism reported by parents in SCQ were significantly better than those of girls with autism. However, both girls with autism and boys with autism improved in the social and communication abilities over the lifetime. The number of stereotypic behaviours in boys significantly decreased over life whereas it remained at a comparable level in girls with autism. CONCLUSIONS: High-functioning females with autism might present better on non-verbal (gestures) mode of communication than boys with autism. It may camouflage other diagnostic features. It poses risk of under-diagnosis or not receiving the appropriate diagnosis for this population. Further research is required to examine this phenomenon so appropriate gender revisions to the diagnostic assessments might be implemented.

Sensorimotor communication in professional quartets.

Non-verbal group dynamics are often opaque to a formal quantitative analysis of communication flow. In this context, ensemble musicians can be a reliable model of expert group coordination. In fact, bodily motion is a critical component of inter-musician coordination and thus could be used as a valuable index of sensorimotor communication. Here we measured head movement kinematics of an expert quartet of musicians and, by applying Granger Causality analysis, we numerically described the causality patterns between participants. We found a clear positive relationship between the amount of communication and complexity of the score segment. Furthermore, we also applied temporal and dynamical changes to the musical score, known by the first violin only. The perturbations were devised in order to force unidirectional communication between the leader of the quartet and the other participants. Results show that in these situations, unidirectional influence from the leader decreased, thus implying that effective leadership may require prior sharing of information between participants. In conclusion, we could measure the amount of information flow and sensorimotor group dynamics suggesting that the fabric of leadership is not built upon exclusive information knowledge but rather on sharing it.

The movements made by performers in a skilled quartet: a distinctive pattern, and the function that it serves.

When people perform a task as part of a joint action, their behavior is not the same as it would be if they were performing the same task alone, since it has to be adapted to facilitate shared understanding (or sometimes to prevent it). Joint performance of music offers a test bed for ecologically valid investigations of the way non-verbal behavior facilitates joint action. Here we compare the expressive movement of violinists when playing in solo and ensemble conditions. The first violinists of two string quartets (SQs), professional and student, were asked to play the same musical fragments in a solo condition and with the quartet. Synchronized multimodal recordings were created from the performances, using a specially developed software platform. Different patterns of head movement were observed. By quantifying them using an appropriate measure of entropy, we showed that head movements are more predictable in the quartet scenario. Rater evaluations showed that the change does not, as might be assumed, entail markedly reduced expression. They showed some ability to discriminate between solo and ensemble performances, but did not distinguish them in terms of emotional content or expressiveness. The data raise provocative questions about joint action in realistically complex scenarios.